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ELECTRONIC STILL CAMERA FOR 
CAPTURING AND CATEGORIZING IMAGES 



[57] ABSTRACT 

An electronic camera captures images representing a variety 
of subjects and categorizes the image according to subject 
matter. The camera comprises an image sensor for capturing 
an image* a converter stage for converting the image into 
digital image data, and a memory for storing a plurality of 
categories providing classification of the images by subject 
Aprocessor in the camera has the capability of assigning the 
plurality of categories to the images captured by the camera* 
with each category providing a subject classification for the 
images, A user selects one or more categories for a plurality 
of images prior to capture, and an output image signal is then 
generated including the digital image data corresponding to 
a captured image and the particular category selected by the 
user. The categories can be default identifiers stored in me 
memory, or can be names, text (Le., account number), and/or 
graphics overlays (ie., company logo) entered via a host 
computer and uploaded to the camera memory before the 
pictures are taken. 

This application is a reissue 
application for U.S. Patent No. 
5,633,678 issued May 27, 1997 
on U.S. Serial No. 08/574,756 
filed December 20, 1995. 
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ELECTRONIC STILL CAMERA FOR 
CAPTURING AND CATEGORIZING IMAGES 

HELD OF THE INVENTION 

This invention pertains to the field of electronic imaging 5 
systems, and in particular to a digital electronic still camera 
of the type that is used with a host computer. 

BACKGROUND OF THE INVENTION 

As understood in the prior art, a digital electronic still 10 
camera is a device which uses an electronic sensor to capture 
an image; signal processing to represent the captured signal 
numerically; and some storage device to preserve the 
numerical image data. It is further known for a digital 
electronic still camera to use a removable storage device, 
such as an integrated circuit memory card, to store images. 
For instance, U.S. Pat No. 5,016,107 describes an electronic 
still camera utilizing image compression and providing 
digital storage in a removable memory card having a static ^ 
random access memory. In this camera, the integrated cir- 
cuits in the removable memory card store image data and a 
directory locating the data. 

Coordination between a digital camera and a computer is 
generally known in the prior art FIG. 1 shows a known ^ 
electronic still photography system useful for inputting 
images to a computer. The system includes an electronic 
camera 1 with an electronic sensing section la. a digital 
processing section lib, a memory card slot 2, and a remov- 
able memory card 3; and a host computer 4 with a built-in 30 
memory card reader 5, a printer 6a> a display 6b, a keyboard 
data entry device 7 and a disk drive 8. Images are captured 
by the sensing section la in the camera 3U manipulated in the 
processing section lb, stored on the memory card 3, and 
transferred from the card 3 to the host computer 4. The 35 
software used to control the sensing and processing sections 
la and lb in the camera is located in firmware memory lc 
in the camera 1. The application software used to control the 
playback operations of the host computer is supplied, at least 
in part by the camera manufacturer. For instance, the ^ 
manufacturer may provide a special disk or memory card 
that comes with the camera. The application software is 
transferred to the computer hard drive 8, and men down- 
loaded to a computer random access memory (RAM) 
memory 9a, where the program is used by a central pro- 45 
cessing unit (CPU) 9b. 

Digital cameras, such as the Kodak Digital Science 
DC40™ camera sold by Kagfman Kodak Company, allow 
almost a hundred images to be stored. Because the images 
are stored as sequentially numbered images, it can be 50 
difficult and time consuming to locate a group of images of 
interest from all of the images stored in the camera. In a 
typical usage, an insurance adjuster may take a number of 
photos in processing a number of different claims during one 
day's operations. It would be desirable to be able to identify 55 
the images of each group, for example by rfaTm number or 
client name. It may be further desirable to allow this 
information, along with the date and time or a company 
logo, to be optionally included with the image data. This 
ensures that any prints made from the camera can be easily go 
identified. Such processing of the captured images is today 
performed in a host computer, such as the host computer 4 
in FIG. 1. 

The Kodak Professional Digital Camera System (model 
DCS- 100) included a digital camera tethered by cable to a 65 
. separate digital storage unit (DSU). The DSU, similar to the 
computer 4 of HG. 1, contained a hard drive for storing 
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images, a small image display, and a keypad for manipulat- 
ing the images. For images mat had already been captured 
by the camera, the system included a **tag" feature that 
allowed a user to flag selected images for later display or for 
5 uploading from the DSU to another computer. Suppose that 
a user wanted to tag a couple of already-captured images for 
later viewing or uploading. The first of the images would be 
brought up on the display and a 'tag*' button on the keypad 
would be pressed, and so on with the other images that are 
to be tagged. Then if the user presses a *find tags'* key on the 
keypad, the first of the tagged images is displayed (and/or 
uploaded). With a second press of the **find tags" key, the 
second tagged image is displayed (and/or uploaded), and so 
on. 

Another embodiment of this camera* the Kodak Hawkeye 
15 n camera, also allowed the user to type in a name for any one 
image after the image was taken, and to add a "note" 
text-string to the image file. Both cameras allowed a simple 
division of already-captured images into 'tagged" and "not- 
tagged" images and required a pattern of keystrokes subse- 
20 quent to capture for every image of interest. In particular, the 
tagging feature functioned more as a post-capture data 
gatekeeper than as a useful tool for image handling. Any- 
thing more complex in the way of data organization requires, 
as shown in FIG. 1. the use of a special application program 
25 in the host computer 4 to organize and sort the image data. 
Consequently, it would be desirable to have an electronic 
still system that could handle image content more efficiently 
in the field than is presently the case. 

30 SUMMARY OF THE INVENTION 

The present invention is directed to overcoming one or 
more of the problems set forth above. Briefly summarized, 
according to one aspect of the present invention, an elec- 
tronic camera captures images representing a variety of 

35 subjects and categorizes the image according to subject 
matter. The camera comprises an image sensor for the 
images, a converter stage for converting the images into 
digital image data, and a memory for storing a plurality of 
categories providing classification of the images by subject 

40 A processor in the camera has the capability of assigning the 
plurality of categories to the images captured by the camera, 
with each category providing subject classification of one or 
more images. A user then interacts with a user control on the 
camera in order to select one or more of the categories for 

45 the images, and an output image signal is then generated 
including the digital image data corresponding to the images 
and the one or more categories selected by the user control. 

The advantage of the invention is that the known provi- 
sion of a simple post-capture <4 tag" is enlarged into useful 

so pre-capture categories that can effectively manage images 
according to variable subject content According to this 
invention, a digital camera includes a display-based ''tag" 
icon/feature which the user can set to an appropriate cat- 
egory before taking a group of pictures. The category names 

55 can be defaults, or can be names and optional text (Le.. 
account number) and/or graphics overlays (i.e„ company 
logo) entered via a host computer and uploaded to the 
camera before the pictures are taken. When the user selects 
a particular category, the category name is stored along with 

60 the image data in the image file, and any text and graphics 
logo, as appropriate, are overlaid onto the image. When 
downloading the images to a host computer, the user can 
select a category and download only the images which have 
a particular category name, or the images can be stored in 

65 folders labeled with each category name. 

These and other aspects, objects, features and advantages 
of the present invention will be more clearly understood and 
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appreciated from a review of the following detailed descrip- 
tion of the preferred embodiments and appended claims, and 
by reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram of a known electronic imaging system 
incorporating a digital camera for inputting images to a host 



FIG, 2 is a block diagram of an electronic camera con- 
figured according to the invention to process and categorize 
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FIG. 3 is a diagram of the status display panel and the user 
control switches used in the camera shown in FIG. 2, 

FEG. 4 is a process diagram for categorizing images 15 
according to default parameters stored in the camera shown 
in FIG. 2. 

FIG. 5 is a process diagram for categorizing images 
according to externally generated parameters supplied to the 
camera shown in FIG. 2. 20 

FIG. 6 is an example of categories that are customized 
from a host computer. 

FIG. 7 is an example of a file format resulting from 
customized categories. ^ 

FIG. 8 is an example of an image display with customized 
category information overlaid into the image. 

FIG. 9 is an addhronal diagram of the status display panel 
and the user control switches set up for activating an overlay 
feature. 30 

FIG. 10 is an example of an image file management 
structure using categories. 

DETAILED DESCRIPTION OF THE 

INVENTION 35 

Because electronic still cameras employing electronic 
sensors are well known* the present description will be 
directed in particular to elements forming part of, or coop- 
erating more directly with, apparatus in accordance with the 40 
present invention. Elements not specifically shown or 
described herein may be selected from those known in the 
art Certain aspects of the embodiments to be described are 
provided in software. Given the system description as 
described in the following materials, all such software 45 
implementation is conventional and within the ordinary skfll 
in such arts. 

FIG. 2 shows an electronic still camera capable of cat- 
egorizing images as taught by the invention. The electronic 
still camera is divided generally into an input section A and 50 
a compression and recording section B. The input section A 
includes an exposure section 10 for directing image light 
from a subject (not shown) toward an image sensor 12. A 
flash unit 11 may be used to iHuminate the subject Although 
not shown, the exposure section 10 includes conventional 55 
optics for directing the image light through a diaphragm, 
which regulates the optical aperture, and a shutter, which 
regulates exposure time. The sensor 12, which includes a 
two-dimensional array of photosites corresponding to pic- 
ture elements of the image, is a conventional charge-coupled 60 
device (CCD) using, e.g., either well-known interline trans- 
fer or frame transfer techniques. The sensor 12 is exposed to 
image light to capture a particular image; accordingly, 
analog image charge information corresponding to the par- 
ticular image is generated in respective photosites. The 65 
charge information is applied to an output diode 14, which 
converts the charge information to analog image signals 
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corresponding to respective picture elements of the particu- 
lar image captured. 

Hie analog image signals are applied to an A/D converter 
16, which generates digital image data from the analog input 

5 signals for each picture element The digital image data is 
applied to an image buffer 18 for storing one or more 
images, albeit shown in FIG. 2 as a random access memory 
(RAM) with storage capacity for a plurality of still images. 
A programmed control processor 20 generally controls the 

10 input section A of the camera by initiating and controlling 
exposure (by operation of the diaphragm and shutter (not 
shown) in the exposure section 10), by controlling the flash 
unit 11, by generating the horizontal and vertical clocks 
needed for driving the sensor 12 and for clocking image 

is information therefrom, and by enabling the A/D converter 
16 in conjunction with the image buffer 18 for each signal 
segment relating to a picture element Exposure control 
would typically be effected by using ambient light informa- 
tion from a photocell 19, and a shutter button 21 allows the 

20 user to initiate a capture cycle. The processor 20 also 
receives date and time information from a date/time gen- 
erator 20a. 

Once a certain amount of digital image data has accumu- 
lated in the image buffer 18, the stored data is applied to a 

25 programmed digital signal processor 22, which controls the 
throughput processing rate for the compression and record- 
ing section B of the camera. The algorithms and other 
operating code used by the processor 22 are stored in an 
algorithm memory 28. The digital signal processor 22 com- 

30 presses each still image stored in the image buffer 18 
according to any one of a number of known image com- 
pression algorithms, such as the well-known JPEG (Joint 
Photographic Experts Group) discrete cosine 
transformation-based compression algorithm. The processor 

35 22 applies the compression algorithm from the memory 28 
to the digital image data, and sends the compressed data to 
a removable storage device via a signal port 26. However, 
while compression is shown in the camera of HG. 2, 
compression is not a necessary feature, and uncompressed 

40 data could be stored instead in the removable storage device. 
In this example, the signal port 26 is a card interface and 
the removable storage device is a memory card 24. While a 
memory card 24 is shown in this system as the storage 
device, other devices may be used, such as a floppy disk 

45 magnetic medium, a small hard drive, or optical storage (in 
the latter cases, suitable conventional reading/writing appa- 
ratus would be provided in the camera, e.g., magnetic or 
optical read/write head. etc.). Arepresentative memory card 
is a card adapted to the PCMCIA card interface standard, 

50 such as described in the PC Card Standard, Release 2.0, 
published by The Personal Computer Memory Card Inter- 
national Association, Sunnyvale, Calif., September 1991. 
The memory card 24 accordingly contains solid state 
memory 24a, such as Flash EPROM memory, which the 

55 card uses to store image data files. 

According to this invention, the digital camera includes a 
categorization feature which enables a user to establish an 
appropriate category, providing classification of the images 
by subject, before taking a group of pictures. The category 

60 information can be default code symbols (AJB,C, etc), or 
can be externally-generated category information, such as 
names and optional text (i.e., account numbers) and/or 
graphics overlays (Le., company logos), which is entered via 
a host computer and uploaded to the camera through the 

65 signal port 26 before the pictures are taken or via cable 
connection. After the user selects a particular category, the 
image is captured and the category information is stored in 
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the removable storage device along with the image data in 
the image file, and any text and graphics logo, as 
appropriate, are overlaid onto the image. When downloading 
the images to a host computer, the user can select a particular 
category and download only the images which have a 5 
particular category identifier* or the images can all be 
downloaded and stored in file folders labeled with each 
category name. 

Consequently, the memory card 24 contains additional 
memory to store header files 2Ab containing category inf or- 10 
mation helpful in providing classification of the images by 
subject matter. Such category information may include 
default tag codes, such as simple alphabetic identifiers A, B, 
C, D, eta, or alphanumeric names that can be associated 
with specific images according to subject matter. The header 15 
files 24b can also contain strings of text that identify 
particular images and separate graphics images that signify 
or otherwise identify subject matter. The header files 246 can 
also contain instructions to overlay all or part of the category 
information into the image data files 24a, or, alternatively, 2 o 
the digital signal processor 22 can access an algorithm in the 
algorithm memory 28 which accomplishes the overlay, and 
then stores all or part of the category information with the 
image data. 3ft is a further feature of this invention that the 
externally generated category information can be supplied to 25 
the digital camera through the signal port 26. Such exter- 
nally generated category information can be stored in the 
Card Information Structure (CIS) of the PCMCIA Format 
(as described in the aforementioned Release 2.0), in the 
header data file 246, or in a portion of the memory space of 30 
the memory 24a used to store the image data. 

The camera also contains a memory section 31, including 
firmware memory 32a with operating code for the camera, 
as well as RAM instruction memory 32b connected to 
receive code from the memory card 24. When the memory 35 
card 24 is inserted into the camera, the processor 20 uses the 
firmware algorithms in the memory 32a to determine if the 
memory card 24 contains externally generated files which 
can be used by the camera. If not the firmware algorithms 
supplied with the camera in the memory 32a are used by the 40 
programmable processor 20, In particular, the default cat- 
egory parameters are stored in the firmware memory 32a 
and accessed by the processor 20. If the card does contain 
appropriate externally generated category information, 
however, these are downloaded from the header file section 45 
24b of the card 24 to the RAM instruction memory 32b and 
used by the programmable processor 20 in place of some 
portion of the firmware algorithms supplied with the camera 
from the firmware memory 32a. In this way the camera can 
execute customized category definitions which provide 50 
higher quality or more complex categorization of pictures. 

User control is provided by a status display 30 connected 
to the control processor 20 for displaying information useful 
in operation of the camera, and by a set of user control 
switches 29. The set of user control switches 29 are also 55 
connected to the processor 20 for entering, highlighting, and 
selecting information displayed on the status display 30. In 
accordance with invention, the status display 30 is a liquid 
crystal display (LCD) having a panel configuration 50 such 
as shown in FIG. 3, which includes a ''tag" icon 52a, and an 60 
alphanumeric segmented section 522?. (The panel configu- 
ration includes other typical icons, such as a battery level 
icon 52c, a flash mode icon 52<f, a self-timer icon 52e, and 
an image delete icon 52/.) The user control switches 29 
include a toggle switch 54 and a select button 56. The toggle 65 
switch 54 is used to toggle to a setting once an icon has been 
activated by the select button 56. For example, if the flash 
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mode icon S2d is highlighted and showing that it is the 
currently active control, pressing the select button would 
activate the tag icon 52a and make it me currently active 
control. 

5 While not important to this invention* other Mormation 
displayed on the status display 30 might include typical 
photographic data, such as shutter speed, aperture, exposure 
bias, color balance (auto, tungsten, fluorescent, daylight), 
high/low resolution, low light exposure modes (aperture 

10 preferred, shutter preferred), and so on. Moreover, other 
information unique to this type of camera may be displayed. 
For instance, the memory card 24 would ordinarily include 
a directory signifying the beginning and ending of each 
stored image. This would show on the display 30 as either 

i3 (or both) the number of images stored or the number of 
image spaces remaining, or estimated to be remaining. 

If externally generated category information is present in 
the header file 24b on the card 24, it can also be identified 
on the status display 30. For instance, the externally gener- 

20 ated category information, such as names, text strings, and 
graphics images can be identified and displayed if the status 
display 30 has the appropriate display capability. 
Alternatively, the toggle switch 54 can be used to cycle 
through alphanumeric names that are provided from the host 

25 computer and displayed on the segmented section S2b. 
Selecting any one name then automatically accesses any text 
string or graphics image that might be associated with the 
name in the instruction memory 322>, and stores such strings 
or graphics image with the digital image data. The camera 

30 may also have the additional feature of overlaying a text 
string, or date and/or time from the date/time generator 20a, 
into the image. Whether or not the date/time or text string is 
overlaid in the images of any particular category can be 
controlled by overlay control information for each category 

35 present in the header file 2Ab. Alternately, mis can be done 
from additional icons in the panel configuration 50 and from 
the user control switches 29, as shown in FEG. 9. Date, time, 
name, and text are separately activated by the toggle switch 
54, and w on tt (overlay active) or "off* icons are activated by 

40 the select switch 56. It is assumed that an uploaded graphics 
image would always overlay into the image, but if this is not 
always desirable, then a separate graphics icon may be 
provided for overlay control. 

The process for categorizing images according to default 

45 parameters is shown in FIG. 4, and the process for catego- 
rizing images according to customized, externally generated 
parameters is shown in HG. 5. Referring first to FIG. 4, 
when the camera is first turned on, the "tag" icon 52a will 
be shown only in outline form (step €0). The inner part of the 

so "tag M icon 52a will fill to indicate when the user has 
positively selected the tag feature by activation of the user 
control switches 29. In the default mode, there are a prede- 
termined plurality of possible categories, for example, five 
alphabetic categories A3,GD JE and NONE (or OFF). With 

55 the tag icon 52a activated, the user will select categories 
A.B.C£>,E.NONE (repeat sequence A3, etc.) by pressing 
the toggle switch 54 (step 61). Each press of the switch 54 
causes a different tag code to be displayed on the alphanu- 
meric segment 52b. 

60 After the tag is selected, the user can activate other icons 
by use of the select button 56. Then, when the shutter button 
21 is pressed, the selected category (tag) is associated with 
the digital image data (steps 62, 63). Then the steps 62, 63 
are repeated for any additional images in the same category 

65 Ifa new category is desired, the process reverts to step 6ll 
When all the images are captured, the user connects the 
camera (by cable) or the memory card 24 to a host computer 
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(step 64), such as the host computer 4 illustrated in FIG- 1. 
Using software supplied by the camera manufacturer, the 
user opens a camera application and chooses the desired 
category (step 65). Then the Images from appropriate cat- 
egories stored in the camera, or the memory card 24, are 5 
downloaded to proper file folders according to the category 
data stored wife the digital image data in each file (step 66). 

Hie user may also customize the tags using the host 
computer. As shown in the process diagram of FIG. 5, a user 
inputs category information, such as category names, and 1Q 
related text or graphics images, from the host computer (step 
70). The user men downloads the category information to 
the camera (step 71), This may be done through a tethered 
connection to the camera, or by writing appropriate files into 
the memory card 24. The user turns on the camera (step 72), 
and selects an appropriate category (step 73), At this stage, 15 
the user can also decide to activate the overlay capability for 
date, time, text, and graphics images. The picture is taken 
(step 74), and the category information is optionally overlaid 
into the image (step 75). The digital image data is then stored 
in the memory card 24 together with category information, 20 
either separately or as overlaid into the image data (step 76). 
The remaining steps are substantially the same as in FIG. 4. 

FIGS. 6, 7, and S show examples of categories customized 
from a host computer, following on the previously men- 
tioned claims adjuster example, and the resultmg file format 25 
and image display. As shown in FIG. 6, the categories (tags) 
are given names, optional text strings, and graphics. The 
category information also includes overlay control informa- 
tion indicating whether or not the text string, date, and time 
should be overlaid into the image* In this example, the user, 30 
a free-lance claims adjuster, has created four different cat- 
egories (Hill and H122) for different insurance claims from 
a first insurance company, one (F123) for a claim from a 
second insurance company, and one (KIDS) for personal 
images. The user also indicates whether the text string 35 
should be overlaid into the image, and whether the camera 
should overlay the date and/or time in the image. This 
category Mormation, including names, text, and graphics, is 
then downloaded to the host computer from the memory 
card 24. A typical technique for such downloading is 40 
described in U.S. Ser. No. 08/219,608, entitled '^Electronic 
Imaging System Using a Removable Software-Enhanced 
Storage Device", which is to issue as U,S. Pat No. 5,477, 
2$4 on Dec 19, 1995. 

When programmed by the host or memory card 24, the 45 
number of tag categories that can be selected in the camera, 
and the four-letter name of each category, is as set by the 
user via the host computer. The user selects the appropriate 
category before taking a sequence of images. The tag names 
and text are then included in the image files, as shown in 50 
FIG. 7. In this example, the user selected Tag name Hill 
and took images #1-2. The user then selected Tag name 
KBDS and took images 3-5. Finally, the user selected tag 
name F123 and took image #6. As the images are captured 
and processed, the appropriate overlay information for the 55 
tag chosen is used. For the category "F123", the tag indicates 
that the image should include a graphics overlay, the text 
"Claim #123", and the date/time, as shown in FIG. 8. In a 
further embodiment shown in FIG. 10, images are stored on 
the removable memory card 3 within a file 80 containing a eo 
group of files corresponding to each category. For example, 
file 82 contains images #1 and #2 having tag name "Hill", 
file 84 contains images #3, #4 and #5 having tag name 
"KIDS", and file 86 contains image #6 having tag name 
UFI23". ^ 

After the images from the camera are stored on the 
memory card 24, the card is inserted into the computer 
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memory card reader 5 (see FIG. 1). In applications where the 
memory card may contain category information which can 
be used by the computer, the computer uses the software 
supplied with the camera to check if the memory card 

5 contains such information. If the card does contain appro- 
priate category information, this information is downloaded 
from the card to the RAM instruction memory 9a and used 
by the CPU 9b in combination with the software algorithms 
from the hard drive 8. This allows a quick and convenient 

10 way of categorizing the images accessed by the computer, 
without requiring further intervention from the host com- 
puter. 

According to the invention shown in FIG. 2, the images 
are transferred from the camera to the computer via the 

15 removable memory, rather than a cable interface. Therefore, 
the camera does not have to be in the same location as the 
computer. This makes it possible to view the images from 
the camera in many different locations, on many different 
computers, as long as the computer has the ability to both 

20 accept the removable memory and correctly process the 
image data. Since the removable memory can be used to 
store code for processing the image data in the computer, 
this code can include the processing algorithms needed to 
download the stored images according to the stored catego- 

25 ries. The advantage of storing the processing algorithms on 
the removable memory is that it eliminates the need for a 
separate means of supplying the code, such as the floppy 
disk. Supplying the algorithms along with the images on fee 
removable memory, such as a PCMCIA card, makes it 

30 possible for any computer capable of reading the image data 
from the card to also download and utilize the algorithms 
needed to process the image data in order to create one or 
more files of categorized images. 

The invention has been described with reference to a 

35 preferred embodiment. However, it will be appreciated mat 
variations and modifications can be effected by a person of 
ordinary skill in the art without departing from the scope of 
the invention. For example, the image files shown in FIG. 7 
could be stored in many different types of optical, magnetic, 

40 or solid-state digital memory. The category customization 
information shown in FIG. 6 could be transferred from the 
computer 3 to the camera 1 via a cable connection instead of 
via a removable memory card, or the camera 1 could include 
means for entering category customization information. 

45 PARTS LIST 

1 ELECTRONIC CAMERA 

1A ELECTRONIC SENSING SECTION 
IB DIGITAL PROCESSING SECTION 
50 1C FIRMWARE MEMORY 

2 MEMORY CARD SLOT 

3 REMOVABLE MEMORY CARD 

4 COMPUTER 

5 MEMORY CARD READER 
55 6a PRINTER 

6b DISPLAY 

7 KEYBOARD 

8 HARD DRIVE 

9 A COMPUTER RAM MEMORY 
60 9B CPU 

10 EXPOSURE SECTION 

11 FLASH UNIT 

12 IMAGE SENSOR 
14 OUTPUT DIODE 

65 16 A/D CONVERTER 
18 IMAGE BUFFER 
20 CONTROL PROCESSOR 
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21 SHUTTER BUTTON 

22 DIGITAL SIGNAL PROCESSOR 
24 MEMORY CARD 

24A SOLID STATE IMAGE MEMORY 

24B EXTERNALLY GENERATED DATA FILES 5 

26 SIGNAL PORT 

28 ALGORITHM MEMORY 

29 USER CONTROL SWITCHES 

30 STATUS DISPLAY PANEL 

31 MEMORY SECTION 10 
^^a FIRMWARE MEMORY 

326 INSTRUCTION MEMORY 

34 INTERFACE 

35 NON-VOLATILE IMAGE MEMORY 

36 ELECTRICALLY ERASABLE FIRMWARE MEMORY 15 
38 INTERFACE CABLE 

50 PANEL CONFIGURATION 

52a "TAG" ICON 

Sib ALPHANUMERIC SECTION 

52c BATTERY ICON 20 
52df FLASH MODE ICON 
S2e SELF TIMER ICON 
52/ IMAGE DELETE ICON 
54 TOGGLE SWITCH 

56 SELECTOR SWITCH 25 
60-66 STEPS 
What is claimed is: 



1 . An electronic camera for 
capturing images representing a variety 
of subjects, said camera comprising; 

an image sensor for capturing the 
images; 

a converter stage for converting 
the images into digital image data; 

a memory for storing a plurality 
of categories providing classification 
of the images by subject; 

a processor having the capability 
of assigning the plurality of categories 
to the images captured by the image 
sensor, each category providing 
subject classification of one or more 
images; 

[a user] control means for 
selecting one or more categories for 
the images [before the images are 
captured by the image sensor]; and 

means for generating an output 
image signal comprising an image file 
including both the digital image data 
corresponding to the images and 
separate category data including the 
one or more categories selected by the 
user control, wherein the category data 
is separately accessible for each image 
apart from the image data. 
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2. An electronic camera as claimed in claim 1 wherein the 
memory is firmware and the categories are default categories 
stored in the firmware. 

3. An electronic camera as claimed in claim 2 wherein the 
user control includes a status display for showing the default 
categories and the user control selects a particular one of the 
default categories from those displayed on the status display. 

4. An electronic camera as claimed in claim 3 wherein the 
user controls includes a first control interface for cycling 
through the default categories one-by-one and displaying 
each category individually, and a second control interface 
for selecting a displayed category. 

5. An electronic camera as claimed in claim 1 wherein the 
one or more categories included in the output image data is 
associated with the digital image data in a distinct file 
location. 

6. An electronic camera as claimed in claim 1 wherein the 
one or more categories included in the output image data is 
overlaid into the image data. 

7. An electronic camera as claimed in claim 1 wherein the 
camera further comprises a signal port for receiving exter- 
nally generated categories, and wherein the processor also 
stores the externally generated categories in the memory and 
the user control is further capable of selecting a particular 
one of the externally generated categories. 

8. An electronic camera as claimed in claim 7 wherein the 
externally generated categories are alphanumeric names. 

9. An electronic camera as claimed in claim 7 wherein the 
signal port also receives externally generated text strings for 
one or more of the categories, and wherein the processor 
also stores the text strings in the memory with the one or 
more categories. 

10. An electronic camera as claimed in claim 7 wherein 
the signal port also receives externally generated graphics 
images for one or more of the categories, and wherein the 
processor also stores the graphics images in the memory 
with the one or more categories. 

11. An electronic camera as claimed in claim 9 wherein 
the means for generating an output image signal overlays the 
text strings into the digital image data. 

12. An electronic camera as claimed in claim 10 wherein 
the means for generating an output image signal overlays the 
graphics images into the digital image data. 

13. An electronic camera as claimed in claim 1 wherein 
the memory stores a plurality of default categories providing 
a default classification of the image by a set of codes, and 
wherein the camera further comprises a signal port for 
receiving externally generated categories, the processor 
stores the externally generated categories in the memory, 
and the user control preferentially accesses the externally 
generated categories when they are stored in the memory. 

14. An electronic camera as claimed in claim 13 wherein 
the processor includes date and time information with the 
externally generated categories. 

15. An electronic imaging system using an electronic 
camera as claimed in claim 7 in combination with a host 
processor, wherein the host processor provides the exter- 
nally generated categories to the signal port. 

16. An electronic imaging system as claimed in claim 15 
wherein the output image signal is output to the host 
processor through the signal port and the host processor 
includes an application program which identifies images 
from the categories associated with the digital image data in 
the output image signal and downloads only the digital 
image data from one or more selected categories. 
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17. An electronic camera for 
capturing images representing a variety 
of subjects, said camera comprising: 

an image sensor for capturing a 
particular image; 

a converter stage for converting 
the particular image into digital image 
data; 

a signal port for receiving at least 
one externally generated category 
providing classification of the image 
by subject; 

a memory for storing each 
category provided by the signal port; 

a processor having the capability 
of assigning said at least one category 
stored in the memory to the images 
captured by the camera, each category 
providing subject classification of one 
or more images; 

[a user] control means for 
selecting a particular category for the 
selected image; and 

means for generating an output 
image signal comprising an image file 
including both the digital image data 
corresponding to the particular image 
and separate category data including 
the particular category selected by the 
user control, wherein the category data 
is separately accessible for each image 
apart from the image data. 

18. An electronic camera as claimed in claim 17 wherein 
the externally generated category is an alphanumeric name. 

19. An electronic camera as claimed in claim 17 wherein 
the signal port also receives externally a generated text 
string for the particular category, and wherein the processor 
also stores the text string in the memory with the particular 
category. 

20. An electronic camera as claimed in claim 17 wherein 
the signal port also receives an externally generated graphics 
image for the particular category, and wherein the processor 
also stores the graphics image in the memory with the 
particular category. 

21. An electronic camera as claimed in claim 19 wherein 
the means for generating an output image signal overlays the 
text string into the digital image data. 

22. An electronic camera as claimed in claim 20 wherein 
the means for generating an output image signal overlays the 
graphics image into the digital image data. 
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23. An electronic camera as claimed in claim 17 wherein 
the memory also stores a plurality of default categories 
providing a default classification of the image, and wherein 
the user control preferentially accesses the default categories 
when the signal port does not receive any externally gener- 
ated categories. 

24. An electronic imaging system using an electronic 
camera as claimed in claim 17 in combination with a host 
processor, wherein the host processor provides each exter- 
nally generated category to the signal port. 

25. An electronic imaging system as claimed in claim 24 
wherein the output image signal is output to the host 
processor through the signal port and the host processor 
includes an application program which identifies images 
from the particular category associated with the digital 
image data in the output image signal and downloads only 
the digital image data from the particular category. 

26. An electronic camera as claimed in claim 7 wherein 
the signal port connects to a removable memory card. 

27. An electronic imaging system as claimed in claim 15 
wherein the signal port connects to a removable memory 
card, and the host processor provides the externally gener- 
ated categories to the signal port by writing the categories 
into the memory card. 

28. An electronic imaging system as claimed in claim 15 
wherein a cable connection is provided between the signal 
port and the host processor, and the host processor provides 
the externally generated categories over the cable connec- 
tion to the signal port 

29. An electronic camera for 
capturing images representing a variety 
of subjects, said camera comprising; 

an image sensor for capturing the 
images; 

a converter stage for converting 
the images into digital image data; 

a memory for storing a plurality 
of categories providing classification 
of the images by subject; 

a processor having the capability 
of assigning the plurality of categories 
to the images captured by the image 
sensor, each category providing 
subject classification of one or more 
images; 

[a user] control means for 
selecting one or more categories for 
the images [before the images are 
captured by the image sensor]; 

means for storing the digital 
image data in image files; and 
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means for grouping the image 
files according to the plurality of 
categories. 



30. A method using an electronic 
camera for capturing images 
representing a variety of subjects, said 
method comprising the steps of: 

storing a plurality of categories 
providing classification of the images 
by subject; 

assigning at least one of the 
plurality of categories to the images 
[before the images are captured by the 
electronic camera], each category 
providing subject classification of one 
or more images; 

capturing the images with the 
electronic camera; 

converting the images into digital 
image data; and 

generating an output image 
signal comprising [in] an image file 
including both the digital image data 
corresponding to the images and 
separate category data including the 
one or more categories selected by [the 
user] a control, wherein the category 
data is separately accessible for each 
image apart from the image data. 



3 1 . The electronic camera according 
to claim 1 wherein the control means is 
a user control. 



32. The electronic camera according 
to claim 17 wherein the control means 
is a user control. 



33. The electronic camera according 
to claim 29 wherein the control means 
is a user control. 



34. The method according to claim 
30 wherein the control is a user 
control. 
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Honorable Assistant Commissioner for Patents 
Box Patent Applications 
Washington, D.C. 20231 

Sir: 

37 CFR § 1.175 STATEMENT OF INOPERATIVENESS 
OF ORIGINAL PATENT (INVENTOR) 

Applicants, Kenneth A. Parulski, Thomas A. Napoli and David M. 
Lewis declare that: 

We have reviewed and understand the contents of the specification, 
including the claims, of the attached reissue application. 

We believe ourselves to be the original, first, and joint inventors of 
the subject matter claimed in ELECTRONIC STILL CAMERA FOR 
CAPTURING AND CATEGORIZING IMAGES for which we solicit a patent, 
described and claimed in our original Letters Patent No. 5,633,678 ('678 patent), 
issued May 27, 1997, based on U.S. Patent Application Serial No. 574,756, filed 
December 20, 1995 and for the attached specification for which invention we 
solicit a reissue patent. As to the subject matter of the application, we do not 
know and do not believe that this subject matter was ever known or used in the 
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United States prior to our invention or discovery thereof. We have the following 



citizenship, residence and post office addresses: 
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Parulski 


FIRST GIVEN NAME 

Kenneth 


SECOND GIVEN NAME 

A. 
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RESIDENCE & 
CITIZENSHIP 


CITY 

Rochester 


STATE OR FOREIGN COUNTRY 

New York 14617 


COUNTRY OF CITIZENSHIP 

USA 


1 


BUSINESS 
ADDRESS 


BUSINESS ADDRESS 

Eastman Kodak Company 


CITY 

343 State Street, Rochester 


STATE & ZIP CODE (COUNTRY) 

New York 14650 USA 
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Napoli 


FIRST GIVEN NAME 

Thomas 


SECOND GIVEN NAME 

A. 
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RESIDENCE & 
CITIZENSHIP 


CITY 

Rochester 


STATE OR FOREIGN COUNTRY 

New York 14692 


COUNTRY OF CITIZENSHIP 
USA 
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BUSINESS 
ADDRESS 


BUSINESS ADDRESS 

Eastman Kodak Company 


CITY 

343 State Street 


STATE & ZIP CODE (COUNTRY) 

New York 14650 USA 
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FULL NAME OF 
INVENTOR 


FAMILY NAME 

Lewis 


FIRST GIVEN NAME 

David 


SECOND GIVEN NAME 
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CITIZENSHIP 


CITY 

Phoenix 


STATE OR FOREIGN COUNTRY 

Arizona 85048 


COUNTRY OF CITIZENSHIP 
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We believe that our issued '678 patent is partly inoperative by 
reason of our claiming less than we had a right to claim in that the claims are 
limited to a user control for selecting one or more categories for the images before 
the images are captured whereas the invention has much broader applications. 
The invention was disclosed to the patent attorney who wrote the application 
using a user control for selection of one or more categories before the images are 
captured as an example of this invention and as the embodiment which had 
immediate commercial interest. We believe that one skilled in the art, after 
reading our issued' 678 patent, would clearly understand that selecting one or 
more categories for the images does not have to be performed before the images 
are captured, and that the control for the selection does not have to be a user 
control. The claims actually prosecuted in the original application were, by 
mistake, inadvertently all directed to the user control for category selection before 
image capture embodiment. 

The present reissue application overcomes the inoperativeness of 

the patent. 

We acknowledge our duty to disclose information of which we are 
aware is material to the examination of this application. 

The errors arose without any deceptive intention on our part. 

We hereby appoint Pamela R. Crocker, Registration No. 42,447; 
Arthur H. Rosenstein, Registration No. 24,352; J. Lanny Tucker, Registration No. 
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27,678; Milton S. Sales, Registration No. 24,516 and Sarah Meeks Roberts, 
Registration No. 33,447 as our attorneys to prosecute this application and to 
transact all business in the United States Patent and Trademark Office connected 
therewith. Please address all written communications to Thomas H, Close, 
Eastman Kodak Company, Patent Legal Staff, Rochester, New York 14650-2201 
and direct all telephone calls to Mrs. Pamela R. Crocker at 716-477-0553. 

The undersigned declare further that all statements made herein of 
their own knowledge are true and that all statements made on information and 
belief are believed to be true; and further that the statements were made with the 
knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under Section 1001 of title 18 of the United States 
Code; and that such willful false statements may jeopardize the validity of the 
application or any patent issuing thereon. 
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USER TURNS ON CAMERA 
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USER SELECTS APPROPRIATE 

CATEGORY ICON AND 
CHOOSES DESIRED CATEGORY 
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USER TAKES PICTURE BY 
DEPRESSING SHUTTER BUTTON 
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IMAGE IS STORED IN FILE ALONG 
WITH CATEGORY ' 
CHOSEN BY THE USER 




USER CONNECTS CAMERA 
OR MEMORY CARD TO 
THE HOST COMPUTER 



65 



USER OPENS CAMERA 
APPLICATION AND CHOOSES 
DESIRED CATEGORUES) 
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IMAGES FROM APPROPRIATE 
CATEGORIES ARE DOWNLOADED 

TO PROPER FOLDERS 
ACCORDING TO THE CATEGORY 
IN EACH IMAGE FILE 



FIG. 4 
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USER DOWNLOADS CATEGORIES/ TEXT/GRAPHICS 
TO CAMERA USING CABLE OR MEMORY CARD 
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USER TURNS ON CAMERA 
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USER SELECTS APPROPRIATE CATEGORY ICON 
AND CHOOSES DESIRED CATEGORY 



USER. TAKES PICTURE BY 
DEPRESSING SHUTTER BUTTON 



AS IMAGE IS PROCESSED, OPTIONAL TEXT 

GRAPHICS AND/OR DATE TIME iS 
OVERLAYED INTO IMAGE IF ENABLED FOR 
THE CATEGORY CHOSEN BY USER 




IMAGE IS STORED IN FILE ALONG WITH CATEGORY 
NAME AND OPTIONAL TEXT FOR THE CATEGORY 
CHOSEN BY THE USER 



YES 



MORE IMAGES FOR* 
JHIS CATEGORY 
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USER CONNECTS CAMERA OR MEMORY 
CARD TO THE HOST COMPUTER 
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USER OPENS CAMERA APPLICATION AND 
CHOOSES DESIRED CATEGOR(IE$) 



FIG. 5 
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IMAGES FROM APPROPRIATE CATEGORIES ARE 
DOWNLOADED TO PROPER FOLDERS ACCORDING 
TO THE CATEGORY NAME IN EACH IMAGE FILE 
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STORED IMAGE FOR 
SELECTED CATEGORY F 123 



CAPTURED 
IMAGE 



CLAIM #123 



TEXT 



Fly-by-night 
Insurance Co. 



GRAPHIC 
DATE/TIME' 



Fly-by-night 
Insurance Co. 




Nov. 9, 1995 
10-15 am 



Claim #123 
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DECLARATION OF MARY ELIZABETH READ 

I, Mary Elizabeth Read, declare: 

1 . I am Manager of Patent Operations at Eastman Kodak Company 
("Kodak") and have held that position since 1988. 

2. My responsibilities include: (1) overseeing the functions of the 
Kodak Patent Legal Staffs paralegal support staff, including docketing, payment 
of maintenance fees and renewals, instituting foreign filings, and maintaining 
PCT files as well as (2) establishing the Kodak Patent Legal Staffs administrative 
procedures. 

3. On August 18, 1992, 1 implemented Kodak's policy (copy 
attached) of destroying all original U.S. patents once appropriate computer entries 
had been entered in our docketing system. U.S. patents which issued prior to 
August 18, 1992, were removed from storage in Kodak archives and destroyed 
pursuant to this policy. 

4. As indicated in the attachment, the Kodak Patent Legal Staff was 
advised by Murriel E. Crawford, Associate Solicitor, U.S. Patent and Trademark 
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Office, that Kodak's policy of destroying original U.S. patents would satisfy the 
"inaccessible" requirement of 37 CFR § 1.178. 

5. Original U.S. Patent 5,633,678; granted May 27, 1997, has been 
destroyed, pursuant to Kodak's above-described policy, and therefore, that patent 
is inaccessible. 

6. I declare further that all statements made herein of my own 
knowledge are true and that all statements made on information and belief are 
believed to be true and further, that the statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the United States Code; 
and that such willful false statements may jeopardize the validity of the 
application or any patent issuing thereon. 
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OFFICIAL COPIES OF U.S. PATENTS 



Effective August 18, 1992: 

Al! official "ribboned" copies of U.S. Patents will be destroyed after the 
appropriate computer entries are made in our internal data base. 

Those U.S. Patents currently stored at Concord Archives will be destroyed. 

U.S. Assignments will be retained for the life of the patent by Patent Operations. 

With regard to reissue proceedings, the text of a letter dated July 6, 1992, to 
J. Jeffrey Hawley from Murriel E. Crawford, Associate Solicitor at the USPTO 
follows: 

"The 'ribbon copy' of a patent need not be surrendered in a reissue 
proceeding if it has been been destroyed or discarded. A 
declaration stating that Kodak destroyed or discarded the 'ribbon 
copy' would be sufficient to base a conclusion of Inaccessibility 1 . 

However, if Kodak gives the 'ribbon copy' of the patent to someone 
such as the inventor, Kodak would be required to seek to obtain 
the 'ribbon copy' before same would be considered 'inaccessible'." 



This procedure has been approved by Patent Legal Staff Management. 
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